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(54) Video searching, video ififormation production, and storage medium for storing processing 
program therefor 



(57) A video searching method, and apparatus 
(101), having a function of' representing a video file are 
provided such that the contents of video files stored in a 
storage device may be recognized definitely and rapidly, 
The video searching apparatus includes a computer, a 
storage device (103), a device for controlling them, and 
a display device (100). The apparatus includes a soft- 
ware resource (108) for producing a group image 
formed of at least two still images of scenes represent- 
ing the contents of each of video files stored in the stor- 
age device. In the apparatus, the size of the group 
image is changed at any time. In response to manipula- 
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tion of the group image, file operation such as deletion, 
movement or name change of a corresponding video 
file is performed. A digest for displaying scene still 
images at predetermined intervals on the display device 
for each of the video files is produced when confirming 
the details of contents of a stored video file. A further 
digest is produced for each of the intervals of the digest 
of the video file, further produces a digest to conduct 
reproduction for searching from a scene still image 
selected on the digest of the video file. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to a video s 
searching method, and apparatus, capable of repre- 
senting contents of a video file stored in a storage 
device as a group of images so as to make the contents 
of the video file definitely recognizable without repro- 
ducing the video file. 

[0002] As the speed of computers becomes higher 
and the capacity of storage devices such as hard disks 
becomes larger in recent years, it has become possible 
to handle moving images and voices by digitizing them. 
There have come to be staged various multimedia sys- 75 
terns such as a VDR (video disk recorder) capable of 
compressing moving images and voices, and storing 
and reproducing the compressed moving images and 
voices, and a nonlinear editing machine capable of edit- 
ing moving images and voices taken into a storage 20 
device such as a hard disk in program production of tel- 
evision broadcast and video production, in these multi- 
media systems, various kinds of attribute information 
such as file format, file name, production date and hour, 
reproduction time, the total number of frames, data rate. 2S 
compression factor, keyword, and a still image of a top 
scene, i.e., top picture frame of a video file are used in 
order to search a large number of video files stored in a 
storage device such as a hard disk. Especially as exam- 
ples of a video searching technique for facilitating the 30 
confirmation of contents of video material of an enor- 
mous amount stored in a storage device, techniques 
disclosed in JP-A-5-81348 (applied for a patent by Dain- 
ihon Printing) and JP-A-8-227462. for example, can be 
mentioned. In the former-cited publication, a frame 35 
extracting and searching apparatus for ananging time- 
axis images obtained from moving images recorded on 
a tape medium, on a time axis and displaying them as 
still images extracted at fixed intervals is disclosed. 
However, there is no concept of image extraction from a 4c 
video file- According to the latter-cited technique, it is 
possible to divide moving images into scenes on the 
basis of the characteristic values of images and voices, 
and produce a list of top picture frames of respective 
scenes. By refen-ing to the display of this list, the user 4i 
can definitely recognize contents of respective video 
files, know what material exists, and select a desired 
scene easily. Here, a scene means a moving image 
section having no intermission taken by one camera. In 
the case where moving images are stored in a storage s 
device as video files respectively con-esponding to 
scenes, an abrupt change does not occur between 
frames, each of which is a still image forming moving 
images, in a scene. By referring to a still image informa- 
tion of a top scene of that video file, therefore, its con- £ 
tents can be sufficientiy grasped. The still image 
information of the top scene of the video file becomes a 
very important visual information in searching for a 



video file. 

SUMMARY OF THE INVENTION 

[0003] Such a conventional apparatus has the follow- 
ing problem. 

[0004] In the case where each scene is stored in a , 
storage device as a video file, its contents can be 
judged on the basis of only the still image information of 
the top scene of that video file. In general, however, 
moving images or video images are not necessarily 
stored in a storage device as video files by taking a 
scene as the unit. In such a case, each video file is 
formed of a plurality of scenes. In selecting a desired 
video file out of a large number of video files stored in a 
storage device, it is very difficult to judge the content of 
a video file by referring to only the still image information 
of the top scene of the video file. For certainly searching 
for and selecting a desired video file, it becomes neces- 
sary to advance the search work while reprodudng that 
video file thoroughly and confirming it. Therefore, it 
takes much time to search enormous video files stored 
in a storage device such as a hard disk. 
[0005] Furthermore, in general, video images in use 
are produced by editing enormous video materials. If at 
the time of video editing work it is possible to search for 
video materials without gdng away from the video edit- 
ing work, editing the video materials searched for. and 
storing the result of the editing into a storage device, 
then it is natural that the video editing work can be 
advanced more efficiently. 

[0006] Therefore, an object of the present invention is 
to provide a video searching method, and apparatus, 
having a function necessary for and useful for a work for 
searching for a video file, and a function of displaying a 
group of images, wherry the user can rapidly recog- 
nize the content of a video file such as a general view, 
for each of video files stored in a storage device. 
[0007] Another object of the present invention is to 

I provkje a video searching method, and apparatus, hav- 
ing a function of storing moving images or video images 
in a storage device, and conducting a display so as to 
make the user capable of recognizing the content of a 
stored video file rapidly and definitely, i.e., judging the 

j general view rapidly under control from a video editing 
system. 

[0003] In accordance with one aspect of the present 
invention, a video searching method for searching and 
displaying moving images or video images desired by 

0 the user comprises the steps of extracting as nnany 
images as specified beforehand by the user from each 
of video files already stored, an-anging the images in an 
arrangement specified beforehand by the user to form a 
group image, displaying the group image in a predeter- 

5 mn&i position, and displaying the moving images or 
video images corresponding to the displayed group 
image selected by the user. As a result, the contents of 
that video file can be recognized rapidly and definitely. 
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Therefore, the efficiency of the work of searching enor- 
mous video files is increased. 

[0009] In accordance with another aspect of the 
present invention, a video searching method, and appa- 
ratus, having the above described search and display 
function has means for managing the moving images or 
video images and is provided with a function of control- 
ling a storage device which stores the moving images or 
video images. Furthermore, the video searching 
method, and apparatus, is provided with a function of 
editing the stored moving images or video images. As a 
result, the contents of the stored moving images or 
video images can be recognized definitely. At the time of 
video editing work, therefore, desired moving images or 
video images can be searched for certainly In addition, 
the moving images or video images thus searched for 
can be edited efficiently, and a result of the editing can 
be stored in the storage device efficiently. 
[001 0] Other objects, features and advantages of the 
present invention will become apparent from reading 
the detailed description of embodiments of the invention 
taken in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWING 

[0011] 

FIG. 1 is a diagram showing a system configuration 
of a video searching method, and apparatus, in one 
embodiment of the present invention, a processing 
program configuration for executing functions con- 
cerning the present invention, and information 
stored in an external storage device 103; 
FIG. 2 is a diagram showing the configuration of a 
video information storing table 302 stored In the 
external storage device 103; 
FIG. 3 is a diagram showing the configuration of a 
digest setting table 303 stored in the external stor- 
age device 103; 

FIG. 4 is a diagram showing the configuration of a 

multi-Icon (multi-still images) setting table 304 

stored in the external storage device 103; 

FIG. 5 is a diagram showing the general stream of 

processing concerning a video searching method, 

and apparatus, In an embodiment of the present 

invention; 

FIG. 6 is a diagram showing processing A con- 
ducted when a multi-icon display request is issued; 
FIG. 7 is a diagram showing an algorithm used 
when producing a still Image file (bit-map file) to be 
used for multi-icon display; 

FIG. 8 is a diagram showing a method for arranging 
still images extracted from a video file when pro- 
ducing a still image file to be used for multi-icon dis- 
play: 

FIG. 9 is a diagram showing a method, different 
.from that of FIG. 8, for arranging still images 
extracted from a video file when producing a stili 



image file to be used for multi-icon display; 
FIG. 10 is a diagram showing a method, different 
from that of FIG. 8 and that of FIG. 9. for arranging 
stiir images extracted from a video file when pro- 
5 ducing a still image file to be used for multi-icon dis- 

play: 

FIG. 11 is a diagram showing processing B con- 
ducted when a digest display request is Issued; 
FIG. 12 is a diagram showing a screen (initial 

10 screen) on a display device 100 obtained in an 
embodiment of the present invention Immediately 
after execution of a GUI program 200, which is a 
processing program equipped with an interactive 
environment between the user and the system 

15 shown in FIG. 1 to comprehensively control a video 
file reproducing function program 201, a video 
recording function program 202, an icon producing 
function program 203, and a video file information 
acquiring function program 204. 

20 FIG. 13 is a diagram showing a screen on the dis- 
play device 100 obtained when video files are dis- 
played in a multi-icon form; 

FIG. 14 is a diagram showing a screen on the dis- 
play device 1 00 obtained when video files are dls- 
25 played In a multi-icon form different from that of 
FIG. 13; 

FIG. 15 Is a diagram showing a screen on the dis- 
play device 100 obtained when video files are dis- 
played In a multi-icon form different from that of 
30 FIG. 13 and that of FIG. 14; 

FIG. 16 is a diagram showing a behavior conducted 
when an icon of a video file displayed in a multi-icon 
form is double-clicked; 

FIG. 17 Is a diagram showing a screen on the dis- 
ss play device 100 obtained when a video file is dis- 
played in a digest from; 

FIG. 18 is a diagram showing a state obtained by 
extracting only a digest window 13 displaying 
frames of a video file at equal frame intervals from 

40 fig! 17 and enlarging the digest window 13; 

FIG. 19 Is a diagram showing a state obtained by 
extracting only a digest window 13 displaying 
■frames of a video file at equal time intervals from 
FIG. 17 and enlarging the digest window 13; 

45 FIG. 20 is a diagram showing a behavior conducted 
when a digest display of a video file shown in FIG. 
18 or 19 Is performed and an Image of a certain 
frame number is double-clicked; 
FIG. 21 is a diagram showing a behavior conducted 

50 when a digest display is further performed for a sec- 
tion ranging from a selected frame Image to the 
next frame image in the digest of the video file of 
FIG. 18; 

FIG. 22 Is a schematic block diagram showing one 
55 embodiment to which the present invention has 
been applied; 

FIG. 23 is a schematic block diagram showing a dif- 
ferent embodiment, different from the embodiment 
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of FIG. 22, to which the present invention has been 
applied; and 

FIG. 24 is a schematic block diagram showing a fur- 
ther different embodiment, different from the 
embodiment of FIG. 23. to which the present inven- 
tion has been applied. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0012] Embodiments of the present invention will be 
described by referring to accompanying drawing. 
[0013] FIG. 1 exemplifies a system configuration of a 
video searching method, and apparatus, according to a 
representative embodiment of the present invention, an 
example of a processing program configuration for exe- 
cuting functions concerning the present invention, and 
information stored in an external storage device 103. 
First of all, the above described system configuration of 
the video searching method, and apparatus, will now be 
described. As shown in FIG. 1. the video searching 
method, and apparatus, are equipped with a display 
device 100 and a video searching apparatus 101 con- 
nected to the display device 1 00 to send predetermined 
signals thereto. This video searching apparatus 101 
includes a CPU 107 for system control, a memory 108 
for storing a program and the like for executing process- 
ing in the CPU 107. a coding means 109 for digitizing 
moving images, or moving images and voices and con- 
verting them into a format which can be processed by 
the video searching apparatus 101, a decoding means 
110 for corKlucting conversion which is inverse of the 
conversion of the coding means 109. a voice output 
interface (l/F) 111, and a video input/output interface 
(l/F) 112 functioning to send/receive data to/from an 
external video apparatus 102. In addition, a keyboard 
105 and a mouse 106 are connected to the video 
searching apparatus 101. 

[0014] Furthermore, to the video searching apparatus 
101. there are connected a video reproducing appara- 
tus 102 for reproducing video images formed of moving 
images, or formed of moving images and voices 
recorded on video tape or the like via the video 
input/output interface 112, an external storage device 
1 03 for storing as a video file, a result of conversion of 
video images input from the video reproducing appara- 
tus 1 02 to a format which can be processed by the video 
searching apparatus 101, conducted by the coding 
means 109 included in the video searching apparatus 
101 . and a speaker 104 for outputting voices input from 
the video reproducing apparatus 102 as they are, or 
outputting original voices restored from a video file 
stored in the external storage device 103 by the decod- 
ing means 110 included in the video searching device 
101. 

[0015] Hereafter, an image obtained by displaying a 
still image file of top scenes of video files in a browsing 
window 1 1 as shown in FIG. 12 is referred to as single 



icon. A group image obtained by displaying, in the 
browsing window 1 1 , a still image file produced from still 
images of at least two scenes extracted from video files 
is referred to as multi-icon. Still images of scenes are 
5 extracted from video files at predetermined time inter- 
vals or frame intervals as still image files. Those still 
image files are displayed on a digest window (as shown 
in FIGS. 17 to 21) as images in the order of time axis 
together with a time code of that scene. This is referred 
10 to as digest. 

[0016] FIG. 1 further shows a processing program 
configuration for executing functions concerning the 
present invention, and information stored in the external 
storage device 103. These processing programs are 
15 stored in the external storage device 103, and they are 
transferred to the memory 108 according to a command 
of the CPU 1 07 caused by a user's start request A GUI 
(graphic user interface) program 200 is a processing 
program providing an interactive environment between 
20 the user and the system shown in FIG. 1 to comprehen- 
sively control four programs described later, i.e.. a video 
file reproducing (playback) function program 201, a 
video recording function program 202. an icon produc- 
ing function program 203, and a video file information 
25 acquiring function program 204. This GUI program 200 
has a buffer 205 for temporarily storing a processing 
result and the like in each processing. In the external 
storage device 103. there exist a set 300 of video files 
already stored by the video recording function program 
30 202, a set 301 of still image files for storing still image 
files of still images of top scenes for respective video 
files in the video file set 300 and still image files used for 
the multi-icon, a video file information storing table 302 
for storing video file attribute information such as a file 
35 name, a file format, production date and hour, and the 
total number of frames for each of the files in the video 
file set 300, a digest setting table 303 for storing matters 
set for the digest display, and a multi-icon setting table 
304 for storing matters set for producing still image file 
40 used to display the multi-icon. The video file reproduc- 
ing function program 201 is a processing program 
called when the user requests the GUI program 200 to 
reproduce video files stored in the video file set 300 of 
the external storage device 103. The video recording 
45 function program 202 is a processing program called 
when the user requests the GUI program 200 to store 
video images such as moving images, or moving 
images and voices in the external storage device 103. 
The icon producing function program 203 is a process- 
so ing program for extracting a still image of a scene from 
a video file stored in the video file set 300 of the external 
storage device 103 and producing a still image file to be 
used to display a desired image or image group. The 
produced image file is stored in the still image file set 
55 301 of the external storage device 103, and displayed to 
the user by the GUI program 200. The video file infor- 
mation acquiring function program 204 is a processing 
program for acquiring video file attribute information 
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such as a video file name, a file format, production date 
and hour, and the total number of frames from a video 
file stored in the video file set 300. The acquired video 
file attribute information is stored in the video file infor- 
mation storing table 302. and displayed to the user by 
the GUI program 200. In the video searching apparatus 
101 , the functions concerning the present invention are 
executed by the processing of the CPU 107 according 
to a program such as the GUI program 200. 
[0017] FIG. 2 shows components forming the video 
file information storing table 302. This video file informa: 
tion storing table 302 is a table required not only when 
displaying a video file in the multi-icon form but also 
when displaying a certain video file in the digest form. 
The video file information storing table 302 includes a 
video file name 400, a file format 401 , a production date 
and hour 402, the total number of frames 403, a byte 
size 404, a bit rate 405, a reproduction time 406, a pic- 
ture size 407 of a video file when it is stored, and a key- 
word 408. The video file name 400 represents a name 
that a video file stored in the external storage device 
1 03 is provided with by the user. The file format 401 rep- 
resents a format to which the video file has been con- 
verted so that the video searching apparatus~101 may 
process it when it is stored in the external storage 
device 103 by the coding means 109. The production 
date and hour 402 represents the date and hour when 
the video file has been stored in the external storage 
device 103. The total number of frames 403 represents 
the total number of frames of moving Images or video 
images stored in the extemal storage device 103. The 
byte size 404 represents the data amount of the video 
file when it has been stored in the external storage 
device 103 by the coding means 109. The bit rate 405 
represents the amount of data coded and stored in the 
external storage device 103 by the coding means 109 
per second. The reproduction time 406 r^resents the 
time required to reproduce the video file stored in the 
external storage device 103 until the end is reached. 
The picture size 407 represents the resolution used 
when the video file is reproduced. The keyword 408 rep- 
resents a remarks column given to the video file stored 
in the external storage device by the user. Each of rows 
of the video file information storing table 302 is stored in 
the external storage device 103 as an attribute informa- 
tion file corresponding to each video file. The video file 
information storing table 302 is formed of those attribute 
information files. 

[0018] FIG. 3 shows elements forming the digest set- 
ting table 303. This digest setting table 303 is a table 
required, when displaying a certain video file in the 
digest form, to cause a change to setting desired by the 
user at any time. The digest setting table 303 is formed 
of a time/frame selection flag 500, time interval value 
501. and frame interval value 502. The time/frame 
selection flag 500 represents a flag for selecting 
whether a digest should be produced at time intervals or 
a digest described later should be produced at frame 



intervals. The time interval value 501 represents an 
interval setting value used when producing a digest at 
time intervals. The frame interval value 502 represents 
an image pickup interval setting value used when pro- 

5 ducing a digest at frame intervals. With reference to 
FIG. 3, the time/frame selection flag 500 is set to T 
when producing a digest at time intervals, and set to F 
when producing a digest at frame intervals. By the way 
T represents the first letter of "TRUE," and F represents 

70 the first letter of "FALSE." The example of FIG. 3 is set 
so as to produce a digest at equal intervals of 5 sec- 
onds. 

[0019] FIG. 4 shows elements forming the multi-icon 
setting table 304. This multi-icon setting table 304 is a 

15 table required, when displaying a video file in the multi- 
icon form, to cause a change to setting desired by the 
user at any time. The multi-icon setting table 304 is 
formed of the number 600 of longitudinal sheets and the 
number 601 of lateral sheets. The number 600 of longi- 

20 tudinal sheets represents the number of longitudinal still 
images in producing a still image file used to conduct a 
multi-icon display by arranging still images in a matrix 
form. The number 601 of lateral sheets represents the 
number of lateral still images in producing a still image 

25 file used to conduct a multi-icon display by arranging still 
images in a matrix form. The example of FIG. 4 is set so 
as to produce a multi-icon display with three longitudinal 
sheets and three lateral sheets, i.e.. a total of nine 
sheets. 

30 [0020] Hereafter, it is assumed that various video 
images are already supplied from the video reproducing 
apparatus 102, converted to such a format that the 
video searching apparatus 101 can process by the cod- 
ing means 109, and stored in the external storage 

35 device 103 as video files. 

[0021 ] FIG. 5 shows the flow of the entire processing 
concerning the video searching method, and apparatus, 
of the present invention. If there is a start request of the 
GUI progriam 200 from the user at step 700, the CPU 

40 107 reads the GUI program 20.0 from the extemal stor- 
age device 103, stores it in the memory 108, and starts 
it. Upon being started, the -GUI program 200 reads out 
the icon producing function program 203 and the video 
file information acquiring function program 204 onto the 

45 memory 108, and starts them at step 701 . For each of 
all video files stored in the video file set 300, it is deter- 
mined at step 702 whether there are a still image file of 
the top scene extracted from each of the video files, and 
an attribute information file (FIG. 2) storing the video file 

50 name, file format, production date and hour, and the 
like. If all of them exist, their still image files and the 
video file information storing table 302 are read out and 
stored in the buffer 205 as shown in step 704. If even 
one of them does not exist, then at step 703 the GUI 

55 program 200 produces a still image file of the top scene 
and an attribute information file for each of video files 
lacking its still image file and attribute information file, 
stores them respectively in the still image file set 301 
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and the video file information storing table 302, thereaf- 
ter reads out and stores those still image files and the 
video file information storing table 302 in the buffer 205. 
At step 705. the icon producing function program 203 
and the video file information acquiring function pro- 
gram 204 on the memory 108 are finished. Thereafter, 
at step 706. the GUI program 200 displays an interac- 
tive video file search window 10. a browsing window 1 1 , 
and a corrtrol panel 12 as shown in FIG. 12 on the dis- 
play device 100. At step 707, the GUI program 200 dis- 
plays the still image file and the video file information 
storing table 302 stored in the buffer 205 in the browsing 
window 1 1 . The processing described heretofore is ini- 
tializing processing conducted by starting the GUI pro- 
gram 200. At step 708, it is determined whether there is 
an exit request issued by the user. If there is not an exit 
request, processing of steps 709 to 712 is conducted, if 
there is an exit request, this GUI program 200 is closed. 
When the user wants to exit the GUI program 200, the 
user may click an exit menu 19 of a menu 15 (FIG. 12). 
At step 709, it is determined whether there is a multi- 
icon display request of a video file issued by the user. If 
there is a multi-icon display request, processing respon- 
sive to selecting a multi-icon display menu 29 from an 
icon display menu 16 is conducted at step 710. This is 
referred to as processing A. If there is not a multi-icon 
display request, it is determined at step 711 whether 
there is a digest display request of a video file issued by 
the user. If there is a digest display request, processing 
responsive to selecting a digest display menu 34 from a 
digest menu 18 is conducted at step 712. This is 
referred to as processing B, if there is not a digest dis- 
play request, then it is determined at the step 708 
whether there is an exit request, and then it is deter- 
mined whether there is a multi-icon display request. 
Details of the processing A of the step 710 and the 
processing B of the step 712 will be described below. 
[0022] Hereafter, details of the processing A and the 
processing B of FIG. 6 will be described. 
[0023] FIG. 6 shows the processing A conducted at 
the step 71 0 of FIG. 5 when there is a multi-icon display 
request issued by the user. In the processing of FIG. 6, 
manipulation for displaying a single icon in the browsing 
window 1 1 and manipulation for displaying a multi-icon 
are shown (see FIG. 12). This processing A is started by 
selecting the icon display menu 16 out of the menu 15 in 
the interactive video file searchir>g window 10. At step 
800, either the single icon display menu 28 or the multi- 
icon display menu 29 included in the icon display menu 
ir selected. If the single icon display menu 28 is 
selected, still image files of top scenes corresponding to 
respective video files are read out and stored in the 
buffer 205 at step 801 . At step i502, they are displayed 
in predetermined positions of the browsing window 1 1 
as single icons. If the multi-icon display menu 29 is 
selected, then the multi-icon setting table 304 is read 
out from the external storage device 103 and stored in 
the buffer 205 at step 803. and its content is displayed 



on the display device 100 at step 804. At step 805, the 
user is prompted to input setting matters, i.e., the 
number of still images of the scenes of the video file in 
the longitudinal and that in the lateral directions. There- 
5 fore, the user conducts setting as the user desires. At 
step 806, the input setting matters are stored in the 
multi-icon setting table 304 in the buffer 205. and then 
the multi-icon setting table 304 is stored in the external 
storage device 103. Then it is determined at step 807 
70 whether a still image file (bit-map file) used to display 
the multi-icon of the current table setting, which image 
file correspond to each of stored video files included in 
the video file set 300 in the external storage device 103 
exists in the set 301 of still image files. If it exists, then 
15 at step 808 those still image files of the external storage 
device 103 are read and stored in the buffer 205. and 
those are displayed in predetermined positions of the 
browsing window 11 as a multi-icon at step 809. If there 
is even one which does not exist in the set 300, then at 
20 Step 810 the video file information acquiring function 
program 204 is started. For each of the video files 
whose necessary still image files do not exist, an 
attribute information file corresponding to each of those 
video files is read from the video file information storing 
25 table 302 and stored in the buffer 205. At step 81 1 . the 
icon producing function program 203 is started, and the 
multi-icon setting table 304. and video files in the video 
file set 300 having no required still image files are read 
out and stored in the buffer 205. Thereafter, at step 812, 
30 respective video files stored in the buffer 205, attribute 
information files corresponding to those video files, and 
the multi-icon setting table 304 are read out. From each 
of the video files, still images of scenes are extracted by 
a multi-icon producing algorithm of FIG. 7 described 
35 later. Respective still image files required for represent- 
ing the multi-icon are produced. Those still Image files 
are stored in the buffer 205. In addition, still image files 
which already exist in the still image file set 301 and 
which are necessary for displaying the multi-icon of the 
40 current setting are also read out and stored in the buffer 
205. At step 813, the icon producing function program 

203 and the video file information acquiring program 

204 are finished. At step 814, respective still image files 
for multi-icon display are read out and displayed in pre- 

45 determined positions of the browsing window 11 as a 
multi-icon. Finally, at step 815, the still image files, 
attribute information files, and the multi-icoh setting 
table 304 in the buffer 205 are stored in the external 
storage device 103. As a result, the processing A is 

so completed, and a single icon or multi-icon can be dis- 
played in the browsing window 1 1 . In both the single 
icon display and the mufti-icon display, selection of an 
expansion icon menu 30 (FIG. 12) in an icon size menu 
17 causes the icon producing function program 203 to 

55 be started, the still image files used for that icon display 
to be read into the buffer 205, changed into still image 
files for expanded display, and displayed in the browsing 
window 11 again, and thereafter the icon producing 
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function program 203 to be finished. In the same way, 
selection of a standard icon menu 31 (FIG. 12) In the 
icon size menu 1 7 causes the icon producing function 
203 to be started, the still image file used for its icon dis- 
play to be read into the buffer 205, changed into still 5 
image files for standard display, and displayed in the 
browsing window 1 1 again, and thereafter the icon pro- 
ducing function program 203 to be finished. Selection of 
a contraction icon menu 32 (FIG. 12) in the icon size 
menu 17 causes the icon producing function 203 to be w 
started, the still image file used for its icon display to be 
read into the buffer 205, changed into still image files for 
contracted display, and displayed in the browsing win- 
dow 1 1 again, and thereafter the icon producing func- 
tion program 203 to be finished. These manipulations 15 
make possible three stages of display, i.e., expansion, 
standard, and contraction, together with the single icon 
and multi-icon. In initial setting, the standard display is 
set. Furthermore, by selecting the single icon or the 
multi-icon in the browsing window 11 and conducting 20 
the drag and drop manipulation with the mouse 106 of 
FIG. 1 . file manipulation such as deletion, movement or 
name change of a video file corresponding to the single 
icon or the multi-icon can be accomplished. Further- 
more, by conducting double-click manipulation with the 
mouse 106 of FIG. 1, it is also possible to reproduce a 
video file corresponding to the selected single icon or 
multi-icon. 

[0024] FIG. 7 shows the flow of the multi-icon produc- 
ing algorithm used in FIG. 6. In order to display the cur- 
rent setting on the display device 100, the algorithm 
begins with reading out the multi-icon setting table 304 
of the external storage device 103 and storing it in the 
buffer 205 of the memory 108 at step 900. At this time, 
the number of sheets of the selected scene still image 
for one video file is set to H in the longitudinal direction 
and set to W in the lateral direction. At step 901, 
attribute information files con-esponding to the video 
files which are contained in the video file information 
storing table 302 and which do not have still image files 
required to display the multi-icon of the current setting 
are read out into the buffer 205. The total number of 
frames is acquired and stored. It is assumed that the 
total number of frames acquired at that time is N. At step 
902, from the values of H and W of the multi-icon setting 
table 304 stored in the buffer 205, a product H x W is 
calculated, and the product is stored in the buffer 205. 
The product is denoted by M. At step 903, a quotient 
N/M is calculated from the values of N and M stored in 
the buffer 205, and stored in the buffer 205. The quo- 
tient is denoted by D. At step 904, the video file is read 
out; and stored in the buffer 205. From that video file. M 
scene still images, i.e., still images of frame number 0, 
frame number (D-*-l), frame number 2(D+1). ... frame 
number (M-1)(D+1) (= N-1) are extracted and stored in 55 
the buffer 205. At step 905, those M still images are 
read out, arranged in the order of time axis, and pro- 
duced as one still image file. As for the arrangement in 



the order of time axis, there are three kinds and the user 
can select at any time. 

[0025] FIG. 8 shows how the multi-icon producing 
algorithm of FIG. 7 arranges M extracted still images in 
the order of time axis to form one still image file and dis- 
plays a multi-icon by using the still image file. FIG. 8 is 
formed of the display device 100. the interactive video 
file searching window 10, the browsing window 11, a 
matrix-shaped multi-icon 36, and still images 39 of the 
respective frame numbers of the video file. As shown in 
FIG. 8, the still images are arranged in a matrix form in 
the order of time axis beginning with the leftmost top, 
and thus one still image file is formed. By using that stilt 
image file, the arranged still images are displayed in a 
predetermined position of the browsing window 11 as a 
matrix-shaped multi-icon 36. One of the matrix-shaped 
multi-icons 36 is enlarged and illustrated. M still images 
39 having respective frame numbers are arranged as 
shown in FIG, 8 to form one still image file. By repre- 
senting the still image file as a multi-icon, the matrix- 
shaped multi-icon 36 is obtained. 
[0026] '. FIG. 9 shows how the multi-icon producing 
algorithm of FIG. 7 arranges M extracted still images in 
the order of time axis to form one still image file and dis- 
plays a multi-icon by using the still image file. FIG. 9 is 
formed of the display device 100. the interactive video 
file searching window 10. the browsing window 11. a 
multi-icon 37 having still images arranged sideways, 
and still images 39 of the respective frame numbers of 
the video file. As shown in FIG. 9, the still images are 
arranged sideways in the order of time axis from the left, 
and thus one still image file is formed. By using that still 
image file, the arranged still images are displayed in a 
predetermined position of the browsing window 1 1 as a 
multi-icon 37 having still images arranged sideways. 
One of the multi -icons 37 having still images arranged 
sideways is enlarged and illustrated. M still images 39 
having respective frame numbers are arranged as 
shown in FIG. 9 to form one still image file. By repre- 
senting the still image file as a multi-icon, the multi-icon 
37 having still Images arranged sideways is obtained. 
[0027] FIG. 10 shows how the multi-icon producing 
algorithm of FIG. 7 arranges M extracted still images in 
the order of time axis to form one still image file and dis- 
plays a multi-icon by using the still image file. FIG. 10 is 
formed of the display device 100, the interactive video 
file searching window 10, the browsing window 11, a 
multi-icon 38 having still images arranged lengthwise, 
and still images 39 of the respective frame numbers of 
the video file. As shown in FIG. 10, the still images are 
arranged lengthwise in the order of time axis from the 
top, and thus one still image file is formed. By using that 
still image file, the arranged still images are displayed in 
a predetermined position of the browsing window 1 1 as 
a multi-icon 38 having still images arranged lengthwise. 
One of the multi -icons 38 having still images arranged 
lengthwise is enlarged and illustrated. M still images 39 
having respective frame numbers are arranged as 
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shown in FIG. 10 to form one still image file. By repre- 
se n the still image file as a multi-icon, the multi-icon 
S ng stili images arranged lengthwise is obtained. 
[0. FIG. 11 is a diagram showing the processing B 
conQ^^cied at the step 712 of FIG. 5 when there is a 
digest display request issued by the user. In FIG. 11, 
manipulation for conducting digest display setting and 
manipulation for displaying a digest of a video file in a 
digest window 13 (FIG. 17 to 19) are shown. The 
processing B is started by selecting either a digest set- 
ting menu 33 or the digest display menu 34 (FIG. 12). At 
step 1000. either the digest setting menu 33 or the 
digest display menu 34 is selected. If the digest setting 
menu 33 is selected, then the digest setting table 303 is 
read out from the external storage device 103 and 
stored in the buffer 205 at step 1 001 . At step 1002, con- 
tents of the digest setting table 303 are displayed on the 
display device 100. At step 1003, the user changes the 
setting as the user desires. At step 1004, the change is 
stored in the digest setting table 303 of the buffer 205. 
At st^ 1 005, the digest setting table 303 is stored in the 
external storage device 103. When conducting a digest 
display next time, the digest display is conducted 
according to the setting. If the user selects the digest 
display menu 34. a digest display of a specified video 
file is conducted in the digest window 13. Hereafter, its 
flow will be described- First of all. at step 1006. the icon 
producing function program 203 is started. At step 
1007. the video file information acquiring function pro- 
gram 204 is started. At step 1008, a specified video file 
is read from the video file set 300 of the external storage 
device 103 into the buffer 205 and stored in the buffer 
205. At step 1009. the digest setting table 303 is read 
out from the external storage device 103 by using the 
GUI program 200 and stored. At step 1010. still images 
of scenes are extracted from the video file stored in the 
buffer 205 at intervals set in the digest setting table 303 
stored in the buffer 205, by using the icon producing 
function program 203, and stored in the buffer 205. At 
step 1011, time codes are extracted from the video file 
stored in the buffer 205 at intervals set in the digest set- 
ting table 303 stored in the buffer 205. by using the 
video file information acquiring function program 204. 
and stored in the buffer 205. At step 1012, the still 
images of scenes and the time codes stored in the 
buffer 205 are read out and displayed in the digest win- 
dow 13 in the order of time axis. At step 1013, therefore, 
the video file information acquiring program 204 is fin- 
ished. At step 1014, the icon producing function pro- 
gram 203 is finished. As a result, the digest display of 
the video file is completed. 

[0029] FIG- 12 shows an example of a concrete dis- 
play screen of an initial state obtained when the 
proc^sing of FIG. 5 has been finished up to the step 
707. In FIG. 12, there are included the display device 
100, the interactive video file searching window 10, the 
browsing window 1 1 . the control panel 12, the menu 15, 
the icon display menu 16, the icon size menu 17, the 



digest menu 18. the exit menu 19. a rewind button 20. a 
frame rewind button 21 , a play button 22, a stop button 
23. a frame fonward button 24, a fast forward button 25, 
an eject button 2B. and a cursor 1 4. By the way. the cur- 

5 sor 14 moves on the screen of the display device 100 
according to the manipulation of the mouse 106 of FIG. 
1 , and conducts the pointing operation. In the initial set- 
ting, a single icon representing a still image of a top 
scene of each video file is displayed in the browsing 

70 window 11 as shown in FIG. 12 as described before 
with reference to FIG. 5. 

[0030] FIG, 13 shows an example of a concrete dis- 
play in tiie case where still images are arranged in a 
matrix form in the browsing window 1 1 in the multi-icon 

75 display of FIG. 6. FIG. 13 has the same configuration as 
that of FIG. 12 except the browsing window 11. By 
means of this display method using the window 1 1 . it is 
possible to definitely recognize the contents of each of 
the video files at a glance. This example shows the case 

20 where each multi-icon is displayed with the number H of 
sheets in the longitudinal direction in the step 900 of 
FIG. 7 being set to 3, and the number W of sheets in the 
lateral direction being set to 3. 

[0031] FIG. 14 shows an example of a concrete dis- 
25 play in the case where still images are arranged side- 
ways in the browsing window 1 1 in the multi-icon display 
of FIG. 6. FIG. 14 has tiie same configuration as that of 
FIG. 12 except the browsing window 1 1. By means of 
this display method using the window 1 1 . it is possible to 

30 definitely recognize the contents of each of the video 
files at a glance. In the same way as FIG. 13, this exam- 
ple also shows the case where each multi-icon is dis- 
played with tiie number H of sheets in the longitudinal 
direction in the step 900 of FIG. 7 being set to 3. and the 

35 number W of sheets in the lateral direction being set to 
3. Since tiie user has selected still images arranged 
sideways, each multi-icon has 9 still images arranged 
from the left in the order of time axis. 
[0032] FIG. 15 shows an example of a concrete dis- 

40 play in the case where still images are arranged length- 
wise in the browsing window 1 1 in the multi-icon display 
of FIG. 6. FIG. 15 has tiie same configuration as that of 
FIG. 12 except the browsing window 11. By means of 
this display method using the window 1 1 , it is possible to 

45 definitely recognize the contents of each of the video 
files at a glance, in tiie same way as FIG. 13, this exam- 
ple also shows the case where each multi-icon is dis- 
played with the number H of sheets in the longitudinal 
direction in the step 900 of FIG. 7 being set to 3, and tiie 

50 number W of sheets in the lateral direction being set to 
3. Since the user has selected still images arranged 
lengthwise, each multi-icon has 9 still images arranged 
from the top in the order of time axis. 
[0033] FIG. 16 shows a result of reproduction of a 

55 video file conducted by using the decoding means 110 
in response to double-clicking a multi-icon. In FIG. 16, 
the display device 100, the interactive video file search- 
ing window 10, and a display wrindow 27 are included. 
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FIG. 16 shows a result of reproduction conducted by 
double-clicking a multi-icon representing the video file 1 
of FIG, 13, FIG. 14 or FIG. 15. The video image is dis- 
played in the display window 27. For this reproduced 
video image, control such as rewind and frame-rewind 5 
(back) can be conducted by clicking a control button on 
the control panel 12. 

[0034] FIG. 17 shows the concrete entire display 
screen in the case where a digest display of a specified 
video file has been conducted. In FIG. 17, there are 10 
included the display device 1 00, the interactive video file 
searching window 10, the digest window 13, the control 
panel 12. the menu 15. the icon display menu 16. the 
icon size menu 17. the digest menu 18. the exit menu 
19. the rewind button 20. the frame rewind (back) button 15 
21 . the play button 22, the stop button 23, the frame for- 
ward button 24, the fast forward button 25, the eject but- 
ton 26, and the cursor 14. FIG. 17 shows the concrete 
entire display screen of the display device 100 of the 
case where a digest display of a video file 2 has been 20 
conducted. The digest display of the video file 2 will be 
described with reference to FIG. 18. 
[0035] FIG. 1 8 is an enlarged view of the digest win- 
dow 13 of FIG. 17. In FIG. 18, the digest window 13. the 
cursor 14, and time codes 35 are included. FIG. 18 25 
shows an example of a digest display of a certain video 
file conducted at equal frame intervals. In this example, 
scene still images are extracted from the video file 2 at 
45 frame intervals, and they are displayed in the digest 
window 13 as a digest display Above each of images 30 
displayed by using a still image file produced from still 
images of scenes extracted from the specified video file, 
a time code 35 of the still image of that scene is dis- 
played. As a result, details of the video file can be con- 
firmed without conducting reproduction. 35 
[0036] FIG. 19 is an enlarged view of the digest win- 
dow 13 of FIG. 17. In FIG. 19. the digest window 13, the 
cursor 14. and the time codes 35 are included. FIG. 19 
shows an example of a digest display of a certain video 
file conducted at equal time intervals. In this example, 40 
scene still images are extracted from the video file 2 
every 5 seconds, and they are displayed in the digest 
window 1 3 as a digest display. Above each of images 
displayed by using a still image file produced from still 
images of scenes extracted from the specified video file. 45 
a time code 35 of the still image of that scene is dis- 
played. As a result, details of the video file can be con- 
firmed without conducting reproduction. 
[0037] It is now assumed that the user chooses a still 
image of a scene displayed in the digest wnndow 13. and so 
double-clicks the still image of that scene with the 
mouse 106 of FIG. 1. From the still image of that scene 
serving as the head, therefore, the video file is repro- 
duced by using the decoding means 110, FIG. 20 
shows this state. In FIG. 20, the display device 100, the 55 
interactive video file searching window 1 0. and the dis- 
play window 27 are included. In FIG. 20. the video file 2 
is reproduced for searching from a scene having a time 



code of 01:00:20:00 (frame number 600) in the digest 
display of the video file 2 in FIG. 18 or 19. The video 
image is displayed in the display window 27. 
[0038] It is now assumed that the user selects a still 
image corresponding to a desired scene in the digest 
display of the video file and thereafter selects the digest 
display menu 34 (FIG. 12). As a result, a digest display 
of a section ranging from the selected still image to the 
next still image is further conducted in the digest win- 
dow 13. FIG. 21 shows the state at that time. In FIG. 21. 
the digest window 13 and the time codes 35 are 
included. In the case of FIG. 21, the user selects a still 
image corresponding to the scene having the time code 
of 01 :00:20:00 (frame number 600) in the digest display 
of the video file 2 in FIG. 1 8, then conducts setting so as 
to produce a digest display at 5 frame intervals by using 
the digest setting menu 33, and selects the digest dis- 
play menu 34 to conduct the digest display FIG. 21 
shows the digest window 13 in this case. As will be 
understood, scene still images of the video images are 
extracted every 5 frames in the range from the selected 
scene having the time code of 01:00:20:00 (frame 
number 600) to the next scene having the time code of 
01 :00:22:15 (frame number 675). At this time as well, by 
choosing a still image and double-clicking the still image 
with the mouse 106 of FIG. 1. the video file can be 
reproduced by using the decoding means 1 10 from the 
scene of that still image serving as the head. 
[0039] By conducting the multi-icon display of the 
video files stored in the external storage device 1 03 as 
heretofore described, it becomes possible to definitely 
confirm the contents of each of the video files at a 
glance without conducting the reproduction work. In 
addition, by conducting the digest display details of the 
video file can be confirmed without conducting the 
reproduction work. These representation methods of 
the video files are representation methods whereby in 
searching for a stored video file the search can be 
accomplished very efficiently 

[0040] FIG. 22 shows an embodiment in which the 
present invention has been applied to a disk recorder. 
The disk recorder means a video deck using a hard disk 
as storage medium. In this case, it is possible to edit 
video materials supplied from the video reproducing 
apparatus 1 02 by control from a video editing apparatus 
1 13 and store a result of the editing in the external stor- 
age device 103 of the video searching apparatus 101 in 
the form of moving images or video images. Further- 
more, by conducting the multi-icon display in the brows- 
ing window 1 1 or the digest display in the digest window 
13, it is possible to search contents of the video files 
stored in the external storage device 103 of the video 
searching apparatus 101 and confirm the details effi- 
ciently. 

[0041] As for various programs stored in the memory 
108 and the external storage device 103. they can be 
installed from programs stored in a recording medium 
such as a CD-ROM, DVD-ROM or a semiconductor 
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memory. Alternately, they may be loaded from an exter- 
nal device such as a server into the memory 108 or the 
external storage device 1 03 of the present apparatus. In 
the programs, a group image reproducing program and 
a group image searching program are also included. 5 
[0042] FIG. 23 shows an example in which the present 
invention is utilized as a disk recorder via a LAN. In this 
case, the programs stored in a memory 108 of a per- 
sonal computer 11 6 for search are only the icon produc- 
ing function program 203. the video file information 1 
acquiring function program 204. and the GUI program 
for controlling these two programs. Programs stored in a 
memory of a video reproducing and recording appara- 
tus 1 15 located at a distance from the personal compu- 
ter 116 for search are only the video file reproducing is 
program 201 and the video recording function program 
202. In other words, the programs concerning the 
present invention are not stored in one apparatus, but 
stored separately and used. In the video reproducing 
and recording apparatus 1 15. it is possible to store mov- 20 
ing images or video images in the external storage 
device 103 and reproduce the video images by control 
from a video editing apparatus 1 13. The personal com- 
puter 1 16 for search can conduct a search and confirm 
details via a LAN in order to know what video files are 25 
stored beforehand in the external storage device 103 of 
the video reproducing and recording apparatus 115 
located at a distance from the personal computer 1 16 
for search. 

[0043] FIG. 24 shows an example in which an editing 30 
function program 206 is added to the memory 1 08 of the 
personal computer 116 for search in the application 
example of FIG. 23. Programs stored in the memory 
108 of a personal computer 117 for editing/search are 
the icon producing function program 203, the video file 35 
information acquiring function program 204, the GUI 
program 200 for controlling these two programs, and the 
editing function program 206. Programs stored in the 
memory 108 of the video reproducing and recording 
apparatus 115 located at a distance from the personal 40 
computer 1 1 7 for editing/search are only the video file 
reproducing function program 201 and the video record- 
ing function program 202. In this case, the contents of 
stored moving images or video images can be definitely 
recognized by using the multi-icon display or digest dis- 45 
play of the video files. At the time of video editing work, 
therefore, desired moving images or video images can 
be searched for certainly without leaving the editing 
work. In addition, the moving images or video images 
thur searched for can be edited efficiently, and the so 
of editing can be stored in the storage device eff i- 

[0044] The present invention is not limited to the 
embodiments heretofore described, but various 
changes are possible without departing from the spirit of 55 
the present invention. 

[0045] In the present specification, the term "means" 
does not necessarily mean physical means, but 



includes the case where the function of each means is 
implemented by software and the case where the func- 
tion of each means is implemented by hardware. Fur- 
thermore, the function of one means may be 
innplemented by two or more physical means, or the 
function of two or means may be implemented by one 
means. 

[0046] According to the present invention, the con- 
tents of a video file stored in a storage device can be 
definitely recognized by representing the video file by 
means of a multi-icon without reproducing the video file. 
Furthermore, the size of the single icon or the multi-icon 
can be changed at any time. By manipulation of the sin- 
gle icon or the multi-icon, file manipulation such as dele- 
tion, movement and name alteration of a video file 
corresponding thereto can be conducted. In searching 
enormous video files, the work efficiency of the user can 
be increased. Furthermore, by producing a digest dis- 
playing scene still images at predetermined frame inter- 
vals or time intervals for each of the video files, more 
detailed contents can be confirmed. In addition, since 
reproduction can be conducted from a selected posi- 
tion, it is also possible for the user to watch and listen to 
a desired video file. Furthermore, by adding the function 
of controlling the storage device and the function of edit- 
ing the stored moving images or video images, desired 
moving images or video images can be searched cer- 
tainly in the video editing work without leaving the edit- 
ing work, because the contents of the stored moving 
images or video images can be recognized definitely In 
addition, the moving images or video images thus 
searched for can be edited efficiently, and its editing 
result can be stored in the storage device efficiently 

Claims 

1. A video searching method for storing a plurality of 
video images in a storage device (103) respectively 
as video files, and searching and displaying said 
video files, said video searching method comprising 
the steps of: 

for each of said plurality of video files stored in 
said storage device, extracting a plurality of 
images for representing contents of the video 
file, at desired intervals beforehand; 
producing (301) a group image (36. 37. 38) for 
each of said video files from said extracted plu- 
rality of images, said group image representing 
an image obtained by arranging said extracted 
plurality of images in a predetermine^ range 
and lumping said extracted plurality of images 
together; and 

displaying at least one of said group images 
respectively con-esponding to said video files 
stored in said storage device on a display 
device (100). 
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2. A video searching method according to claim 1. 
comprising the steps of: 

causing a user to select a desired video file out 
of said plurality of video files stored in a direc- s 
tory. said directory having a hierarchy structure 
provided by a file system so as to facilitate the 
user's management of said plurality of files 
stored in said storage device; 
extracting a plurality of images from said io 
selected video file at predetermined intervals 
beforehand ; 

displaying said extracted plurality of images on 
. said display device; and 

displaying one of said video images corre- 
sponding to an image selected by the user out 
of said images, from a position of the image 
selected by the user. 

3. A video searching method for storing a plurality of 
video images in a storage device (103) respectively 
as video files, and searching and displaying said 
video files, said video searching method comprising 
the steps of: 
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causing a user to select a desired video file out 

of said plurality of video files; 

extracting a plurality of images from said 

selected video file at predetermined intervals 

beforehand; 

displaying said extracted plurality of images on 
a display device (1 00) 

for extracted images of arbitrary one of said 
intervals, extracting a plurality of images from 
video images corresponding to extracted 
images of said one interval at desired intervals; 
displaying said extracted plurality of images on 
a display device (100); and 
displaying one of said video images corre- 
sponding to an image selected by the user out 
of said images, from a position of the image 
selected by the user subsequently. 



A video searching apparatus (1 01 ) for storing a plu- 
rality of video images in a storage device (103) 45 
respectively as video files, and searching and dis- 
playing said video files, said video searching appa- 
ratus comprising: 

group image producing means for extracting a so 
plurality of images for representing contents of 
each of said plurality of video files stored in 
said storage device, at desired Intervals before- 
hand, and producing a group image (36. 37. 
38) for each of said video files from said ss 
extracted plurality of images, said group inoage 
representing an image obtained by arranging 
said extracted plurality of images in a predeter- 



mined range and lumping said extracted plural- 
ity of images together; and 
group image display means for displaying said 
group image corresponding to each of said 
video files stored in said storage device, said 
group image display means being associated 
with said group image producing means. 

A video searching apparatus according to claim 4. 
comprising: 

means (109, 112) for storing video images in a 
video storage device; 

a video storage device (103) for storing said 
video images therein; and 
means for communicating with said video stor- 
age device. 

A video searching apparatus according to claim 5, 
comprising means (113) for editing stored video 
images. 

A video searching method for storing a plurality of 
video images in a storage device (103) respectively 
as video files, and producing auxiliary video 
searching images to search said video files, 

said video searching method cornprising the 
steps of: j 
for each of said plurality of video f il stored in 
said storage device, extracting a plurality of 
images for representing contents of the video 
file, at desired intervals beforehand; 
producing (301) a group image (36, 37, 38) for 
each of said video files from said extracted plu- 
rality of images, said group image representing 
an image obtained by arranging said extracted 
plurality of images in a predetermined range 
and lumping said extracted plurality of images 
together. 

A computer-readable storage medium storing a 
video searching program for storing a plurality of 
video images in a storage device (103) respectively 
as video files, and searching and displaying said 
video files, said video searching program compris- 
ing: 

an instruction for extracting a plurality of 
images for r^res anting contents of each of 
said plurality of video files stored in said stor- 
age device, at desired intervals beforehand; 
an instruction for producing a group image (36) 
for each of said video files from said extracted 
plurality of images, said group image repre- 
senting an image obtained by an-anging said 
extracted plurality of images in a predeter- 
mined range and lumping said extracted plural - 
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ity of images together; and 

an instruction for displaying said group image 

con-esponding to each of said video files stored 

in said storage device on a display device 

(100). 



5 



9. A computer program product including a storage 
medium, said storage medium storing a video infor- 
mation producing program for storing a plurality of 
video images in a storage device (103) respectively io 
as video files, and producing auxiliary video 
searching images to search said video files by 
using a computer, said computer product compris- 
ing: 

75 

program means recorded on said medium for 
causing the computer to extract a plurality of 
images for representing contents of the video 
file for each of said plurality of video files stored 
in said storage device, at desired intervals 20 
beforehand; and 

program means recorded on said medium for 
causing the computer to produce a group 
image (36) for each of said video files from said 
extracted plurality of images, said group image 25 
representing an image obtained by arranging 
said extracted plurality of images in a predeter- 
mined range and lumping said extracted plural- 
ity of images together. 

30 
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50 
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700 



FIG.5 

^ 

START THE ICON PRODUCING FUNCTION 
PROGRAM 203 AND THE VIDEO FILE 
INFORMATION ACQUIRING FUNCTION 
PROGRAM 204 ON THE MEMORY 108 



IS THERE A START 
REQUEST OF THE GUI 
PROGRAM 200 FROM 
THE USER ? 



ARE THERE A STILL IMAGE FILE OF THE TOP SCENE AND 
AN ATTRIBUTE INFORMATION FILE FOR EACH OF ALL 
VIDEO FILES STORED IN THE VIDEO FILE SET 300 ? 




702 



PRODUCE A STILL IMAGE FILE OF THE TOP SCENE AND AN 
ATTRIBUTE INFORMATION FILE FOR EACH OF VIDEO FILES 
LACKING ITS STILL IMAGE FILE AND ATTRIBUTE INFORMATION 
FILE, AND STORES THEM RESPECTIVELY IN THE STILL IMAGE 
FILE SET 301 AND THE VIDEO FILE INFORMATION STORING 

TABLE 302 



.703 



READ OUT THE STILL IMAGE FILES OF TOP SCENES AND THE 
VIDEO FILE INFORMATION STORING TABLE 3020 INTO THE 
BUFFER 205 AND STORE THEM IN THE BUFFER 205 



EXIT THE ICON PRODUCING FUNCTION PROGRAM 203 AND THE 
VIDEO FILE INFORMATION ACQUIRING FUNCTION PROGRAM 204 

ON THE MEMORY 108 



DISPLAY AN INTERACTIVE VIDEO FILE SEARCH WINDOW 10. 
A BROWSING WINDOW 11, AND A CONTROL PANEL 12 ON THE 

DISPLAY DEVICE 100 



READ OUT THE STILL IMAGE FILE AND THE VIDEO FILE 
INFORMATION STORING TABLE 302 STORED IN THE BUFFER 205. 
AND DISPLAY THEM IN THE BROWSING WINDOW 11 ON THE 
DISPLAY DEVICE 100 
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IS AN EXIT 
REQUEST ISSUED 
BY THE USER 
ABSENT ? 



708 



IS A MULTI-ICON 
DISPLAY REQUEST 
OF A VIDEO FILE 
ISSUED 



N 



709 
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END 



SELECT A MULTI-ICON 
DISPLAY MENU 29 

FROM AN ICON 
DISPLAY MENU 16 
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IS A DIGEST ^ / 
DISPLAY REQUEST / 
OF A VIDEO FILE \ 
ISSUED? \ 


SELECT A 
DIGEST DISPLAY 
MENU 34 FROM A 
DIGEST MENU 18 
(PROCESSING B) 
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MULTI-ICON 
DISPLAY MENU 29 




READ OUT STILL IMAGE FILES OF TOP SCENES IN THE STILL 
IMAGE FILE SET 301 ON THE EXTERNAL STORAGE DEVICE 103 

CORRESPONDING TO RESPECTIVE VIDEO FILES INTO THE 
BUFFER 205 OF THE MEMORY 108 AND STORE THEM THEREIN 

READ OUT THE STILL IMAGE FILES FROM THE BUFFER 205 AND 
DISPLAY THEM IN THE BROWSING WINDOW 1 1 ON THE DISPLAY 
DEVICE 100 



800 



READ OUT THE MULTI-ICON SETTING TABLE 304 FROM THE EXTERNAL STORAGE DEVICE 
103 AND STORE IT IN THE BUFFER 205 OF THE MEMORY 108 



DISPLAY THE CONTENTS OF THE MULTI-ICON SETTING TABLE 304 STORED IN THE 
BUFFER 205 ON THE DISPLAY DEVICE 100 



PROMPT THE USER TO INPUT SETTING MATTERS, I.E., THE NUMBER OF STILL IMAGES 
OF THE SCENES OF THE VIDEO FILE FORMING THE MULTI-ICON IN THE LONGITUDINAL 
AND THAT IN THE LATERAL DIRECTIONS 



STORE THE SETTING MATTERS SPECIFIED BY THE USER IN THE MULTI-ICON SETTING 
TABLE 304 IN THE BUFFER 205, AND STORE THE MULTI-ICON SETTING TABLE 304 IN 
THE EXTERNAL STORAGE DEVICE 103 



IS THERE A STILL IMAGE 
FILE (BIT-MAP FILE) USED TO 
DISPLAY THE MULTI-ICON OF THE 
CURRENTTABLE SETTING.i.E., AN 
ICON DISPLAYING A GROUP IMAGE 
INCLUDED IN THE STILL IMAGE FILE 

SET 301 IN THE EXTERNAL 
STORAGE DEVICE 103 IN THE SET 
300 OF STORED VIDEO FILES ? 




READ OUT THOSE STILL IMAGE FILES OF THE 
EXTERNAL STORAGE DEVICE 103 AND STORE 
THEM IN THE BUFFER 205 



READ OUT THE STILL IMAGE FILES FROM THE 

BUFFER 205, AND DISPLAY THEM IN THE 
BROWSING WINDOW 11 
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START THE VIDEO FILE INFORMATION ACQUIRING FUNCTION PROGRAM 204 FOR EACH OF 
THE VIDEO FILES WHOSE NECESSARY STILL IMAGE FILES DO NOT EXIST, READ OUT AN 
AHRIBUTE INFORMATION FILE CORRESPONDING TO EACH OF THOSE VIDEO FILES FROM 
THE VIDEO FILE INFORMATION STORING TABLE 302 OF THE EXTERNAL STORAGE DEVICE 
AND STORE IT IN THE BUFFER 205 OF THE MEMORY 108 



START THE ICON PRODUCING FUNCTION PROGRAM 203. READ OUT THE MULTI-ICON 
SETTING TABLE 304, AND VIDEO FILES IN THE VIDEO FILE SET 300 HAVING NO REQUIRED 
STILL IMAGE FILES INTO THE BUFFER 205 OF THE MEMORY 108 AND STORE THEM THEREIN 



READ OUT RESPECTIVE VIDEO FILES STORED IN THE BUFFER 205, ATTRIBUTE 
INFORMATION FILES CORRESPONDING TO THESE VIDEO FILES. AND f HE MULTI-ICON 
SETTING TABLE 304. FROM EACH OF THE VIDEO FILES/EXTRACT STILL IMAGES OF 
SCENES FROM EACH OF THE VIDEO FILES, AND PRODUCE RESPECTIVE STILL IMAGE 

FILES REQUIRED FOR REPRESENTING fHE MULTI-ICON BY USING A MULTI-ICON 
PRODUCING ALGORITHM OF FIG. 7. THEREAFTER, STORE THOSE STILL IMAGE FILES 
IN THE BUFFER 205. READ OUT STILL IMAGE FILES WHICH ALREADY EXIST AND WHICH 
ARE NECESSARY FOR DISPUYINGTHE MULTI-ICON OF THE CURRENT SETTING AS 
WELL INTO THE BUFFER 205, AND STORE THEM IN THE BUFFER 205 



FINISH THE ICON PRODUCING FUNCTION PROGRAM 203 AND THE VIDEO FILE 
INFORMATION ACQUIRING PROGRAM 204 



READ OUT RESPECTIVE STILL IMAGE FILES FOR MULTI-ICON DISPLAY, AND DISPLAY 
THEM IN THE BROWSING WINDOW 1 1 



STORE THE STILL IMAGE FILES, ATTRIBUTE INFORMATION FILES, AND THE 
MULTMCON SETTING TABLE 304 IN THE EXTERNAL STORAGE DEVICE 103 
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START (MULTI-ICON PRODUCING ALGORITHM) 



READ OUT THE MULTI-ICON SETTING TABLE 304 OF THE EXTERNAL 
STORAGE DEVICE 103 AND STORE IT IN THE BUFFER 205 OF THE 
MEMORY 108. AT THIS TIME. LET THE NUMBER OF SHEETS SET IN 
THE LONGITUDINAL DIRECTION BE H, AND THE NUMBER OF 
SHEETS IN THE LATERAL DIRECTION BE W 



READ OUTTHE VIDEO FILE INFORMATION STORING TABLE 
302, ACQUIRE THE TOTAL NUMBER N OF FRAMES OF THE VIDEO 
FILE, AND STORE IT IN THE BUFFER 205 



READ OUTTHE MULTI-ICON SETTING TABLE 304 OF THE 
EXTERNAL STORAGE DEVICE 103, AND STORE THE PRODUCT 
HXW IN THE BUFFER 205. LET THE PRODUCT BE M 



READ OUTN AND M STORED IN THE BUFFER 205. AND STORE A 
QUOTIENT N ^M IN THE BUFFER 205. LET THE QUOTIENT BE D 



READ OUTM AND D STORED IN THE BUFFER 205. EXTRACT M 
STILL IMAGES, I.E.. STILL IMAGES OF FRAME NUMBER 0 OF THE 

TOP SCENE. FRAME NUMBER {D+1). FRAME NUMBER 2(D+1). 
. . . FRAME NUMBER N-1 (-(M-1)(D+1)) OF THE LAST SCENE FROM 
THE VIDEO FILE, AND STORE THEM IN THE BUFFER 205 



READ OUTTHE ABOVE DESCRIBED M STILL IMAGES STORED IN 
THE BUFFER 205, ARRANGE THEM IN THE ORDER OF TIME 
AXIS AS SHOWN IN FIG. 8. 9 OR 10, AND PRODUCE ONE STILL 
IMAGE FILE THEREBY 
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DEVICE 103 



STARTTHE VIDEO FILE INFORMATION ACQUIRING FUNCTION PROGRAM 204 
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MEMORY 108 
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DEVICE 103 BY USING THE GUI PROGRAM 200^ AND STORED IT IN THE 
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